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ABSTRACT 

In order to examine whether different results are 
obtained from two sociometric techniques for determining children's 
peer preferences in desegregated schools, two studies were conducted. 
The techniques compared were (1) the traditional peer nomination 
method, in which children list a few classmates whom they consider 
friends; and (2) the roster and rating method, in which each child 
rates all classmates on an interval scale. The first study involved 
meta analysis of existing data. Results of research using the two 
sociometric methods were comparted and it was found that peer 
nomination studies tend to find more same*-race preferences than 
roster and rating studies. The second study involved field research. 
Sixth graders at a newly desegregated school were asked to show their 
peer preferences on both types of measures. Results indicated that 
the peer nomination method results in larger differences in 
preferences for same-race peers over peers of a different race. These 
findings suggest that peer nomination techniques, which restrict the 
number of choices a child can make and thus encourage the naming of 
best friends, should be used to assess close friendships; roster and 
rating methods may be more appropriately used to assess more general 
intergroup acceptance. (Author/HJL) 
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Peer Nomination versus Rating Scale Measurement of 
Children's Peer Preferences in Desegregated Schools 

•One of the social goals of school desegregation is the elimination, 
or at least the reduction, of intergroup prejudice (e.g.. Cook, 1979; 
St. John, 1975; Stephan, 1978). One good indicator of this outcome is 
the degree to which racial in-group and out-group members are equally 
preferred as partners for activities such as work or play. However, a 
large number of studies have found strong preferences to interact with 
in-group members among children in desegregated schools (see reviews by 
St. John, 1975; Schofield, 1978; Stephan, 1978), leading Stephan to 
conclude that "desegregation generally does not reduce the prejudice of 
whites toward blacks" and that it "leads to increases in black prejudice 
toward whites about as frequently as it leads to decreases" (1978:217). 

A common feature of many of the studies leading to this conclusion 
is the use of the traditional sociometric peer nomination method to 
measure peer preferences: each child is asked to list a few (usually 
three to five) classmates who are friends or best friends. Such a 
procedure severely restricts the number of others a child can choose and 
results in the nomination of a few very close friends. If no out-group 
members are included among these choices, one might conclude that out- 
group members are not accepted. It is possible, however, that students 
have reasonably favorable attitudes toward the out-group members , but do 
not consider them to be close enough friends to be included in their 
limited . number of choices. 

A number of more recent studies of peer preferences have used a 
different methodology, the roster-and-rating method, in which each child 
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rates all of his or her classmates on an interval preference scale. As 
discussed below, these studies have found that similarity of race has a 
fairly weak effect on peer preferences. The roster-and-rating method 
also assesses a somewhat different aspect of peer preference than does 
the peer nomination technique. Peer nominations reveal friendships ^ 
whereas the roster-and-rating technique assesses interpersonal 
acceptance, a much less intimate form of relationship (Asher & Hymel, 
1981; Asher & Renshaw, 1981). Since interracial acceptance rather than 
friendship is the goal of school desegregation as a social policy 
(Allport, 1954; Amir, 1976; E. Cohen, 1975), peer nominations may be 
inappropriate as evaluation criteria if their results differ 
substantially from those of a measure of social acceptance, such as the 
roster-and-rating method. Under such conditions, generalizations based 
on peer nomination data concerning the effectiveness of desegregation as 
a social policy, such as those of Stephan (1978) cited above, would have 
to be considered to be tentative rather than conclusive. 

In order to examine the question of whether different results are 
obtained using the two sociometric techniques, this article will first 
briefly review the studies of children's peer preferences in 
desegregated schools which have used the the two methods. We will then 
report the results of two studies — a meta-analysis of previous research 
and a new field study — comparing the effects of the peer nomination and 
roster-and-rating methods of measuring peer preferences on the magnitude 
of assessed in-group preference. 
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Insert Table 1 About Here 



Peer Nomination Studies 

Studies of children's peer preferences in desgregated schools using 
the peer nomination technique are listed in Table !• The studies 
included in this review and the following review of the roster-and- 
rating studies were drawn from those listed in St, John's (1975) 
exhaustive review of the literature. More recent studies were located 
through searches of Sociological Abst racts and Psychological Abstracts , 
and by examination of studies cited in papers obtained from this search. 
The results of the peer nomination studies have been reported using 
three basic formats: nonstatistical descriptions, descriptive 
statistics, and inferential statistics. ^ - 

Descriptions . Fourteen studies reported their results 
descriptively, nine in the form of narratives and five in the form of 
sociographs. Of these 14 studies, all but three (Schmuck & Luszki, 
1969; Stulac, 1979; Yarrow, Campbell, & Yarrow, 1958) reported finding" 
same-race peer preferences. Although the results of the majority of 
these studies suggest a high level of same-race preference, they provide 
no estimate of the magnitude of that preference. 

Descriptive statistics . Five studies reported descriptive 
statistics relating to peer preferences. Polgar (1977) reported that 
24% of the free-play groups she observed were cross-race and concluded 
that th'is indicated same-race preferences. The other studies reported 
Criswell's (1943) group preference index: the ratio of the number of 
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in-group choices* made to the number of out-group choices made, corrected 
for group size. This index can take on values from^ zero to infinity, 
with a value of 1 indicating equal preference for members of both groups 
and values greater than 1 indicating inceasing in-group preferences. 
The mean index value of the four studies using the index was 30.6, 
indicating a high degree of in-group preference. This index value can 
be interpreted as indicating that if the number of black and white 
students in the schools were equal, in-group members would be chosen 
30.6 times as often as out-group members. Since no sampling 
distribution exists for the Criswell index, the probabilities of these 
values occurring by chance cannot be ascertained. 

Inferential statistics . Eleven studies used inferential statistics 
to test the null hypothesis of equal preference for in-group and out- 
group members. Analysis of variance (Koslin, Koslin^ Pargament, & 
Waxman, 1972) and a £-test (Mabe & Williams, 1975) were used to test for 
differences in the proprtion of black children nominated as friends by 
black and white peers in two studies, and the others used chi-squares to 
test for differences in the number of cross-race choices made versus the 
number expected by- chance. For presentation in Table 1, these 
statistics were converted to the percentage of choice variance accounted 
for by similarity of race (cf . Glass, 1977); larger values indicate 
greater same-race preference . In all cases , the percentage of variance 
accounted for was significantly greater than zero, and the mean value 
was 19.0%, These results suggest that moderately strong same-race 
preferences are found among children in desegregated schools. 
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Insert Table 2 About Here 



Roster - and-Rating 

The seven studies of interracial peer preference which have used 
the roster-and-rating method are listed in Table 2. All seven stucUes 
used analysis of variance to analyze their data. The results have been 
converted to the percentage of variance accounted for by similarity of 
rnce to permit comparison with the peer nomination studies using 
inferential statistics. Three of the studies (Carter DeTine, Spero, & 
Benson, 1975; Singleton & Asher, 1977, 1979) failed to find significant 
differences in preferences based on similarity of race, and in only two 
cases (LevTis, 1971; Asher, Singleton & Taylor, 1982, 7th-grade sample) 
did it account for more than 2»5% of the variance. The mean percentage 
of preference variance accounted for by similarity of race was 7,7%, 
compared to 19,0% for the comparable peer nomination studies. 

These marked differences in the amount of variance accounted for by 
similarity of race using the two types of sociometric measures described 
above raises the question of whether the exclusive , restricted choices 
used as data under the peer nomination method might exaggerate the 
assessed degree of same-race preference compared to the roster-and~ 
rating method. Two studies were conducted to investigate this question. 
Study 1 was a meta-analytic comparison of the results of the roster-and- 
rating studies with those of the peer nomination studies which used 
inferential statistics. Study 2 was a field study in which children in 
a newly-opened desegregated school indicated their peer preferences 
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using both types of measures. 



STUDY 1 



Meta-analysis is a method of statistically combining the results of 
independent studies and using inferential statistics to aid in the 
evaluation of a body of research literature (Glass, McGaw, & Smith, 
1981; Rosenthal, 1978). It is a quantitative evaluation of a set of 
related empirical studies which integrates the results of their 
statistical analyses, as opposed to the traditional literature review 
which uses qualitative techniques to integrate a body of literature. 
Meta-analysis provides overall effect size estimates for a set of 
studies based on a metric common to the studies being analyzed, and 
overall Z-scores for the hypotheses tested by the studies. In addition, 
studies can be grouped into categories based on common characteristics, 
and the mean effect ?)izes of the categories can be tested for 
differences (Glass et al., 1981). In the present case, mean effect 
sizes were computed for the peer * nomination and roster-and-rating 
studies and their difference was tested for statistical significance. 
It was expected that the peer nomination method would yield larger 
effect sizes than the ros ter-and-ra[ting method. 



The peer nomination studies included in the meta-analysis are 
listed in the third section of Table 1 and the roster-and-rating studies 
are listed in Table 2. Effect sizes were computed separately by grade 
level where possible, so that the 11 peer nomination studies provided 16 
observations of the effect of racial similarity on peer preferences and 
included a total of 4460 subjects. The seven roster-and-rating studies 
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provided eight observations and included a total of 2159 subjects. Mean 
effect sizes (ES) and combined probability levels ( Zma ) were computed 
for the studies • Zma was calculated by finding the standard normal 
deviate (Z) associated with each effect size's test statistic and 
dividing the sum of the Z-scores by the square root of the number of 
studies involved (cf. Rosenthal , 1978) . Exact ^-scores were calculated 
using the formulas provided by Rosenthal and Hall (1981). 

Results 

Both the peer nomination studies (ES = 19.0, Zma = 20.40, p < 
.0001) and the roster-and-rating studies (ES = 7.7, Zma ^ 8.42, £< 
.0001) found that similarity of race had a statistically significant 
effect on peer preferences. However, as hypothesized, the peer 
nomination ES was larger than the roster-and-rating ES^, ^(22) = 1.65, p^ 
= .055, suggesting that the method used to assess peer preferences 
affects the apparent magnitude of the effect. 

Because effect sizes by grade level were available, the opportunity 
was taken to test Asher et al.'s (1982) suggestion that same-race 
preference increases with grade level . For those studies where results 
were collapsed across grade level (e.g., Criswell, 1939), the m^ian 
grade level included in the study was used. The correlation between 
grade and effect size was .202, .18. Although not statistically 

significant, the magnitude of the correlation indicates that that 
further investigation of this relationship would be worthwhile, since 
the lack of exact grade levels for all studies may have attenuated the 
correlation. 
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Discussion 

The results of the meta-analysis indicate that peer nomination 
studies tend to find more same-race preference than do roster-and-rating 
studies. One possible reason for this difference is the fact that the 
peer nomination method generally restricts the number of choices a child 
can make, thus encouraging the naming of best friends. Cross-racial 
best friendships are unlikely to be found given the residential 
segregation that of ten accompanies school desegregation • The roster- 
and-rating method, on the other handf assesses intergroup acceptance 
without in practice limiting the respondant to best friends: black and 
white students can report liking each other without being best friends. 

There are two plausible alternative explanations for the different 
results obtained with the two methods, however. First, the nomination 
studies are gent>rally older than the roster-and-rating studies, so the 
difference may reflect recently-developed more accepting racial 
attitudes. Secondly, many peer nomination studies were conducted in 
conjunction with school desegregation programs in which black students 
were transferred into formerly all-white schools . The black students 
were therefore newcomers to the established social structures of the 
schools, and newcomers are often poorly received it' children's and 
adolescents ' groups , even when race is not an isoue (e.g., Feshbach , 
1969; Feshbach & Sones, 1971 ; Ziller & Behringer , 1961). This 
newcomer effect is illustrated by Becker's (1967) study of a newly 
desegregated school which received new white students as well as new 
black students. Considering just the white students, newcomer status 
accounted for 10.2% of the peer preference variance, with strong in- 
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group preferences being found, especially among the established 
students. Most of the roster-and-rating studies, on the other hand, 
were conducted in schools that had been desegregated for some time, so 
that race was not confounded with newcomer status. Thus, in order to 
clarify the relationship between the type of measure employed and the 
magnitude of assessed in-group preferences, a second study was conducted 
in which the variables of time and newcomer status were controlled. 

STUDY 2 

Study 2 was conducted in a newly-opened desegregated middle school 
which drew pupils from nearly two dozen elementary schools, thereby 
essentially controlling the newcomer status of the black and white 
students. Students expressed preferences for their classmates using 
both the peer nomination and roster-and-rating techniques. Two 
hypotheses were tested. First, it was expected that similarity of race 
would account for more variance when the peer nomination method was used 
than when the roster-and-rating method was employed. Secondly, it was 
expected that the peer nomination method would yield a larger difference 
between the preference scores given to in-group and out-group members 
than v/Guld the roster-and-rating method. ' Such a finding would indicate 
that the in-group preference as assessed by the peer nomination method 
was stronger than the in-group preference as assessed by the roster-and- 
rating method. In addition to investigating the effects of the 
technique on the assessed magnitude of cross-race preferences, the study 
also assessed cross-sex preferences . A number of both the peer 
nomination studies (e.g., Becker, 1967; Criswell, 1939) and roster-and- 
rating studies (e.g., Singleton & Asher, 1977, 1979; Whitley & 
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Schofield, 1982) have found same-sex preferences to be stronger than 
same-race preferences . 

Method 

Subjects 

Subjects were 29 black male, 35 black female, 30 white male, and 20 
white female sixth-graders who were me\Tibers of . several classrooms 
randomly selected for study as part of a larger research project on 
school desegregation. The school in which the classes were located and 
the demographic characte?:istics of its students are described in 
Schofield (1982). 
Procedure 

The students completed four questionnaires at both the beginning 
and the end of the school year. On the two roster-and-rating 
questionnaires, they rated the degree to which they would like to have 
each of their classmates as a work or as a play partner. Each child's 
preference score for work or play for a race-sex group (e.g., black 
males) was his or her wean rating of all members of that group. On the 
other two questionnaires, the students nominated the three classmates 
they would most like to have as a work or as a play partner. Each 
child's score for a group was the number of persons from that group whom 
he or she named^ Students were told that their responses would be 
confidential and seats were arranged in the classes studied so that 
students could not see each others' responses o The order of the four 
questionnaires was counter- balanced at both administrations. 



12 



Peer Nominations versus Rating Scales Page 12 

Results 

Proportions of Variance 

Students' responses to each of the questionnaires were analyzed 
using 2 (race of subject) x 2 (sex of subject) x 2 (similarity of 
rater's and ratee's race) x 2 (similarity of rater's and ratee's sex) x 
2 (time) ANOVAs. The last three variables were treated as within- 
subjects factors. Percentages of variance accounted for were calculated 
using the formulas provided by Dodd and Schultz (1973). 



Insert Table 3 About Here 



Percentages of variance accounted for by similarity of race and sex 
using the two different sociometric techniques are shown in Table 3. 
Similarity of race accounted for 7.6% of the work variance and 9.6% of 
the play variance when nominations were used, and 0.9% of the work 
variance and 1.1% of the play variance when ratings were used. 
Similarity of sex accounted for 34.6% of the nomination work variance 
and 33.1% of the nomination play variance, and for 36.7% of the rating 
work variance and 40.7% of the rating play variance. Thus, the variance 
accounted for by race was roughly eight times greater for both work and 
play choices with the peer nomination technique than with the roster- 
and-rating technique, whereas the estimates of the variance accounted 
for by sex provided by the two methods were virtually identical. 

Lacking a direct statistical test for differences in percentages of 
variance accounted for, another way to look at these results is to note 
that for similarity of race, the effect sizes in the roster-and-rating 
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data fall within the range categorized by J. Cohen (1977) as small, 
whereas those for nominations fall within the moderate range. Both 
effect sizes for- similarity of sex fall well within the large range. 
Differences in Preference Scores Given to In-Group and Out-Group Members 
Data analysis , The hypothesis that the peer nomination method 
would yield a larger difference between the preference scores given to 
in-group and out-group members than would the roster-and-rating method 
was tested by converting the rating and nomination scores to Z-scores 
(ratings were on 5-point scales and nominations, effectively, on A-point 
scales) and analyzing the scores with two (work and play) 2 (race of 
subject) X 2 (sex of subject) x 2 (method) x 2 (similarity of race) x 2 
,„(similarity of sex) x 2 (time) ANOVAs, The last four variables were 
treated as within-subjects factors. 

The predicted method effect would be indicated by interactions of 
method with similarity of race and sex, since such an interaction would 
suggesr that one method resulted in a larger difference between the 
ratings of in-group and out-group members than did the other. The 
strength of the effect was measured by a^ priori contrasts of the form 
(A-B)-(C-D), where A was the in-group nomination score, B the out-group 
nomination score, C the in-group rating score, and D the out-group 
rating score. In order to avoid taking seriously effects which might be 
statistically significant but account for virtually no variance (cf. 
S. A. Cohen & Hyman, 1977), for an effect to be considered to be 
significant, it had both to reach conventional levels of statistical 
significance and to account for at least 1% of the preference variance 
(cf • J. Cohen, 1977). All F-tests had 1 and 110 degrees of freedom. 
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Initial analyses indicated that there were neither main effects for 
time nor interactions of time with method for either work preferences, 
largest £ = KOI, £ = .SI, or play preferences, largest ¥_ = 2.22, £ = 
.14, so the results were collapsed across time for further analyses. 
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Similarity of race > Mean standardized preference scores for peers 
of the same and different race and sex assessed by nominations and 
ratings are shown in Table 4. As expected, there were main effects for 
similarity of race, with peers of the same race being preferred to peers 
of the other race for both work (same M = .236, different M = -.312), F 
= 77.12, £ < .0001, and play (same M = .262, different M = -.220), F = 
83.38, £ < .0001. Also, as hypothesized, the similarity of race by 
method interaction was significant for work preferences, F = 57.19, p < 
.0001, with the nomination scores being 0.69 standard deviations larger 
than the rating scores, t_ = 3.65, £ < .0005. For play preferences, the 
similarity of race by method interaction was again significant, F = 
40.62, £ < .0001, with the nomination scores being 0.64 standard 
deviations larger than the rating scores, t = 3.11, p < .005. 
Preferences for racial in-group members over out-group members thus 
appear to be stronger when measured by the traditional sociometric peer 
nomination method than when measured by' the roster-and-rating method. 

Similarity of sex . Mean standardized preference scores for peers 
of the same and different sex assessed by nominations and ratings are 
also shown in Table 4. As expected, there were main effects for 
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similarity of sex , wi t h peers of the same sex be ing pref erred to peers 
of the other sex for both work (same M := ,752, different M = -•817), £ = 
1062.91, p < ,0001, and play (same M = ,793, different M = -•859), F = 
1134,17, £ < ,0001. The similarity of sex by method interactions were 
not statistically significant for either the work questionnaires, F = 
2.26, £= .14, or the play questionnaires, F. < !• The sociometric 
method used thus appears to have little effect on the magnitude of 
assessed cross-sex peer preferences. 



Insert Table 5 About Here 



Interaction of similarity of race and sex . There were interactions 
of similarity of race and similarity of sex on both the work 
questionnaires, £ = 72.63, £< .0001, and the play questionnaires, F = 
65.67, £< .0001. The relevant mean standardized preference scores are 
shown in Table 5. Peers of the same 6ex and race were preferred to all 
others for both work and play, £ < .01 by Scheffe's test. There were 
also similarity of race by similarity of sex by method interactions for 
work preferences, = 47.81, £ < .0001, and for play preferences, £ = 
39.32, £ < .0001. For both work and play preferences, similarity of 
race had a larger effect when assessed by nominations than when assessed 
by ratings for peers of the same sex, £ < .01 by Scheffe's test, but 
there was no difference for peers of the other sex. 

Discussion 

The results of this study indicate that the method used to assess 
peer preferences can have a significant effect of the magnitude of the 
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assessed preferences. When the traditional sociometric peer nomination 
method is used, differences in preferences for racial in-group members 
versus out-group members are larger than when the roster-and-rating 
method is used. This difference in the magnitude of the same-race 
preference is probably due to the type of information requested by the 
two methods. The peer nomination method generally has respondants name 
their best friends, whereas the roster-and-rating method measures 
acceptance or how well the respondant likes different members of race 
and sex groups. While cross-racial best friendships may be desirable, 
they go beyond the degree of interpersonal intimacy which desegregation 
as a social policy is designed to bring about (e.g., Allport, 1954; 
Amir, 1976; E. Cohen, 1975). As such, best friendships should not be 
a criterion for success in achieving the social goals of school 
desegregation. 

The failure to find a method difference in the assessment of cross- 
sex preferences is probably due to a ceiling effect caused by the very 
strong homosociality found among sixth-graders (cf. Coleman, 1961; 
Waller, 1967). This homosociality is reflected in the much stronger 
effect that sex , as compared to race , had on preferences , and in the 
fact that method dif f erences- wet^"e for same-sex, but not different- 

sex, peers. The latter received uniformly low preferences regardless of 
method. These results suggest that sex is a more salient characteristic 
in forming peer preferences among sixth-graders than is race. 

Finally, it is interesting to note that time had no effect on peer 
preferences. The results of the roster-and-rating portion of the study 
suggest that the lack of change may have been due to relatively positive 
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initial attitudes of the students which left little room for 
improvement. To the extent that such attitudes become commonplace, 
school desegregation should not be expected to have major effects on 
interracial attitudes. 

CONCLUSIONS 

The results of these two studies suggest that the interpretation of 
research using d^.fferent sociometric methods should be tempered by an 
awareness of the effects which the different measurement techniques can 
have on assessed scores. Thus Stephan's (1978) pessimistic conclusion 
quoted earlier and other reports of the "failure" of the social goals of 
school desegregation may be reflections of measurement artifacts rather 
than of the real state of intergroup relations. Since both the peer 
nomination and roster-and-rating methods have good reliability and 
validity (Asher & Hymel, 1981; Asher & Renshaw, 1981), future research 
on peer preferences should use a variety of methods to assess intergroup 
preferences, and should insure that the operational definitions of 
constructs accurately reflect the conceptual definitions of those 
constructs. Thus, for example, peer nominations should be used to 
assess close friendships, whereas roster-and-rating methods may be more 
appropriate to the assessment of more general intergroup acceptance. 
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Footnote 

'''Analyses conducted on proportions of nominations adjusted for the 
size of the group in the class yielded substantially the same results as 
those reported here. 
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Table 1 Continued 
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Table 3 

Percentage of Peer Preference Variance Accounted for by Race and Sex 
as Assessed "by Nominations and Ratings 

Similarity of Rater's and Ratee's 



Race Sex 

Work Preferences 

Nominations 7.6 34.6 

Ratings 0.9 36.7 

Play Preferences 

Nominations 9.6 33.1 

Ratings 1,1 40.7 
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Table k 

Mean Standardized Preference Scores for Peers of the Same and 
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Table 5 

Mean Standardized Preference Scores for Peers of the Sajne and 
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